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Figure  1.  Subject  being  tested  using  the  T-34C  manual  landing  gear  crank. 

Development  and  Construction  of 
an  Aviation  Strength-Screening 
Device 


J.  L.  Saxton,  J.  W.  McDaniel,  J.  Quinn,  &  T.  L.  Pokorski 


©state-of-the-art,  computer- 
based  cockpit  simulator  for 
testing  pilots’  strength  was 
developed  as  a  joint  effort 
between  the  Naval  Aerospace  Med¬ 
ical  Research  Laboratory  (NAMRL), 
Pensacola,  Florida,  and  the  former 
Armstrong  Laboratory  Human  Engi¬ 
neering  Division  (now  the  Air  Force 
Research  Laboratory  Crew  System  In¬ 
terface  Division),  Wright-Patterson  Air 
Force  Base,  Ohio.  This  unique  device 
has  all  major  cockpit  controls,  includ¬ 
ing  center  stick  aileron/elevator,  wheel 
aileron/elevator,  rudder  pedals, 
center-pull  ejection  handles,  face- 


curtain  ejection  handle,  helicopter 
collective  control,  and  emergency 
landing  gear  crank.  It  houses  a 
computerized  data  acquisition  sys¬ 
tem  to  administer  sophisticated  test 
protocols.  Current  Navy  plans 
include  using  this  customized 
strength-screening  device  to  evalu¬ 
ate  strength-conditioning  programs, 
to  assist  in  matching  pilot  candi¬ 
dates  to  specific  aircraft,  and  to 
better  specify  performance  require¬ 
ments  with  future  aircraft  design. 

Current  Department  of  Defense 
(DoD)  policy  authorizes  both  male 
Continued  on  page  2 
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Figure  2.  Subject  being  tested  using  the  F-18  ejection 
seat  handle. 


and  female  officers  to  become  pilots 
in  all  aircraft.  Presently,  the  Navy 
uses  two  types  of  general  physical 
strength/endurance  evaluations  for 
naval  aviators:  the  Navy  Physical 
Readiness  Test  (PRT)  and  specific 
physical  training  activities  in  the 
Naval  Aviation  Schools  Command 
(NASC)  physical  training  curriculum. 
Although  both  programs  are  gender- 
and  aged-normed,  they  have  not 
been  validated  against  specific 
aviation  occupational  standards.  Sig¬ 
nificant  physical  strength  is  required 
for  both  routine  and  emergency  tasks 
(e.g.,  high-G  maneuvers,  manual 
landing  gear  extension,  ejection  seat 
actuation)  found  in  military  aircraft. 
This  strength-screening  device  was 
developed  to  determine  strength  and 
endurance  capability  by  testing 
aircraft-specific  tasks. 

The  first  phase  of  the  project 
surveyed  each  of  the  aviation  com¬ 
munities  to  identify  strength  tasks 
related  to  their  specific  aircraft.  Once 
the  tasks  were  defined,  the  actual 
forces  required  to  perform  those  tasks 
were  verified  from  actual  measure¬ 
ments  or  through  reference  docu¬ 
mentation  such  as  flight  test  data  and 
military  specifications.  The  screen¬ 
ing  device  was  subsequently 


designed  to  simulate 
specific  tasks  identified  for 
each  aircraft  type.  The  air¬ 
craft/control  combinations 
listed  below  were  based  on 
the  survey  information,  rela¬ 
tive  abundance  in  the  fleet, 
and  how  long  the  aircraft 
was  projected  to  be  used  in 
the  fleet.  The  following  air¬ 
craft/controls  were  simu¬ 
lated  in  the  device: 

■  F-18  Hornet  stick  (elevator 
and  aileron) 

■  F-18  Hornet  rudder  pedals 

■  P-3  Orion  wheel  (elevator 
and  aileron) 

■  UH-60  Seahawk  collective 

■  NACES  ejection  seat  lower 
ejection  handle  (seat  back/ 
pan,  harness) 

■  GRU-7  ejection  seat  face 
curtain  ejection  handle  (and 
headrest) 

9  T-34C  manual  landing 
gear  crank 
The  strength-screening  device 
incorporates  the  features  listed  in 
Table  1. 

To  prevent  subjects  from  adjust¬ 
ing  the  seat  to  an  unrealistic  posi¬ 
tion,  an  adjustable  sighting  device 
aids  the  subject  in  adjusting  the  seat 


(relative  to  the  controls)  to  position 
the  eye  along  the  over-the-nose  vi¬ 
sion  line  for  each  aircraft  (design 
eye  height).  Each  seat-adjust  “box” 
is  stored  in  the  computer  memory  so 
the  seat  and  pedals  cannot  be 
adjusted  outside  the  realistic  range. 


Table  1.  Features  of  the  Strength-Screening  Device 


■  Menu-driven,  computer-based 

■  Automated  testing  of  maximum 

simulator  controller/data  acquisition 

static  strength. 

system. 

■  Second  (repeater)  computer  display 

■  Automated  testing  of  instantaneous 
(demonstration)  testing,  which 

to  provide  instructions/feedback. 

provides  real-time  feedback  of  actual  force(s). 

■  High-fidelity  controls  have  range  of 

■  Precision  electronic  load  cells  to  measure  forces 

motion,  resistance,  size,  and  shape 

applied  to  controls. 

of  selected  aircraft. 

■  Can  be  converted  from  a  stick  to 

■  Adjustment  of  seat  and  pedals  by  computer 
allows  cockpit  geometry  of  any  Navy  aircraft  to 

wheel  control  (or  vice  versa)  by  one 

be  represented:  8  inches  vertical  seat 

person  within  1  minute  without  any 

adjustment;  8  inches  horizontal  seat  adjustment; 

tools. 

and  12  inches  pedal  adjustment. 
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Figure  3.  Subject  being  tested  using  a  sticMeJi  r^uMer pedal 
combination. 


Using  this  approach,  the  performance 
interaction  of  body  size  with  strength 
can  be  simultaneously  evaluated. 
The  combination  of  the  adjustable 
sighting  device  and  the  extra-large 
range  of  adjustment  allows  the 
strength  test  cockpit  to  simulate  any 
Navy  aircraft. 

Except  for  the  isometric  face-cur- 
tain  ejection  control,  all  controls  are 
dynamic  with  the  same  resistance  to 
movement  as  the  aircraft  they  repre¬ 
sent.  Springs  in  the  control  linkage 
provide  high-fidelity  force  profile 
within  the  limits  of  control  move¬ 
ment.  The  controls  are  instrumented, 
precision-load  cells  that  measure  the 
total  force  applied  to  a  control,  even 
if  it  has  already  been  pushed  against 
its  stop. 

Some  of  the  components  of  the 
strength-screening  device,  such  as 
the  ejection  handles,  NACES  seat 
pan,  and  seat  back  (including 
cushions)  are  parts  from  actual  air¬ 
craft,  while  the  plastic  stick  grip  and 
the  hollow  aluminum  wheel  were 
replaced  with  stronger  cast  steel. 


Currently  all  naval 
aviation  candidates  must 
be  able  to  operate  the 
T-34C  emergency  landing 
gear  crank.  This  crank  is 
located  on  the  right  side  of 
the  cockpit  (see  Fig.  1), 
and  operates  similarly  to  a 
window  crank  in  an  auto¬ 
mobile.  A  total  of  42  turns 
is  required  to  completely 
lower  the  landing  gear.  For 
the  first  28  turns,  the  resis¬ 
tance  is  a  mere  5  pounds. 
Beyond  28  turns,  resis¬ 
tance  increases  dramati¬ 
cally  to  25  pounds,  as  the 
wheels  move  further  into 
a  110-knot  wind.  To  simu¬ 
late  the  effect  of  wind  re¬ 
sistance,  the  gear  crank  on 
the  simulator  employs  a 
computer-controlled  elec¬ 
tric  brake  that  increases 
resistance  nonlinearly  as 
the  number  of  revolutions 
increases. 

The  strength-screening  device  seat 
is  a  hybrid,  combining  a  NACES  seat 
bottom  with  a  GRU-7  top,  equipped 
with  a  face-curtain.  The  face-curtain 
ejection  handle  is  the  only  isometric 


control  in  which  the  subject  pulls  as 
hard  as  possible  on  a  stationary 
handle.  This  simulates  the  most  de¬ 
manding  part  of  the  task,  pulling  the 
handle  out  of  its  stowage  latch.  Be¬ 
cause  subjects  are  tested  without 
helmets,  the  headrest  is  offset  for¬ 
ward  so  the  head  will  have  the 
correct  geometry  with  respect  to 
both  the  seat  back  and  the  face- 
curtain  handle.  While  only  40  pounds 
of  force  are  required  to  pull  the 
lower  ejection  handle,  a  precision 
electronic  load  cell  can  measure  the 
maximum  jerk  force  beyond  300 
pounds  (see  Fig.  2).  As  with  the 
other  controls,  total  force  is 
measured,  even  after  the  handle  has 
reached  the  end  of  travel. 

The  operational  sophistication  re¬ 
sides  in  the  modular  software  and 
the  state-of-the-art  computer  data 
acquisition  system.  The  menu-driven 
computer  displays  allow  the  test 
examiner  to  select  from  181 
different  test  combinations.  Figure  2 
shows  the  examiner’s  station  behind 
and  to  the  right  of  the  subject.  Fur¬ 
ther  variations  result  from  being  able 
to  select  any  number  of  combina¬ 
tions  of  forces  and  durations  in  the 
Continued  on  page  4 


Wheel  Aileron  Endurance  Strength  Test 


[Collective  Stick  Pedal  Wheel  Stick/Pedai  Sticl^Coilectlve  Whcel/Pedal 


Contfoi  Ctmicefsl! 


Percent  of  Tamet  Etevatof  j  Peiccrrt  irf  tamet  Aiteroni 


120.00- 

imoo- 

Force  Oirec^onftll 

110.00- 

110.00r 

UmblrtUtedi 

100.00- 

loaop- 

Time  on  Target! 

moo- 

«>.oo- 

Time  off  Taioeti 

00.00- 

80.00- 

i  0.00 1 

1  8S 

i.00j  ■  1  8 

PERCENT  T  ARBET  FORCE  VS.  SAMPLE  NUMBER 


10  20  30  40  50  60  70  80  90  100| 

Sample  Numb<» 


tnoi  g^ro! 


STOP  TEST 


Scanning 


Figure  4.  Computer  screen  for  an  endurance  test. 
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endurance  tests.  Choices  from  the 
menu  enable  a  variety  of  different 
test  protocols  including  a  maximum 
effort  test,  endurance  test,  and  in¬ 
stantaneous  test.  Even  common  com¬ 
binations  of  controls  (e.g.,  stick/ 
rudder  pedal,  wheel/rudder  pedal, 
stick/collective)  are  possible  when 
conducting  endurance  and  instan¬ 
taneous  tests.  The  subject’s  display, 
shown  in  Figure  3,  pictures  a 
student  performing  a  stick/left  rud¬ 
der  pedal  combination  test. 

Figure  4  shows  an  endurance  test 
computer  screen.  After  selecting  a 
control  or  control  combination  from 
the  top  bar  of  the  display,  the  com¬ 
puter  prompts  the  operator  to  enter 
the  direction  of  force,  the  target 
force(s)  for  the  control(s)  selected 
and  the  duration  of  the  test  (sec¬ 
onds).  To  complete  an  endurance 
test,  subjects  must  maintain  a  mini¬ 
mum  95%  of  the  target  force(s)  on 
the  control(s)  for  the  duration  of  the 
test.  A  clock-type  countdown  timer 
displays  the  time  remaining  to  both 
the  examiner  and  the  student. 

Test  data  are  stored  in  the  computer 
in  two  different  formats.  One  type  of 
file  includes  the  names  of  all  param¬ 
eters  together  with  their  selected  or 
measured  values.  The  other  type  of 
file  contains  only  numerical  values  for 
importing  into  a  database  or  spread¬ 
sheet.  Both  files  are  automatically 
created  when  the  operator  chooses  to 
save  the  data  from  any  of  the  tests. 

This  joint  program  illustrates  how 


the  services  cooperate  to  share  exper¬ 
tise  and  technology  to  save  time  and 
money  for  the  military.  The  develop¬ 
ment  of  the  strength-screening  device 
was  a  challenging  hardware/software 
system  acquisition  that  included  de¬ 
veloping  requirements,  engineering, 
designing,  building,  testing,  docu¬ 
menting,  and  even  training.  Although 
the  device  is  complete,  under  a  5-year 
Memorandum  of  Agreement,  the  Navy 
and  Air  Force  labs  will  continue  to 
share  data  and  technology  for  their 
mutual  benefit.  C 

For  further  information  plea.se  contact: 
Jack  Saxton 

Naval  Aerospace  Medical 
Research  Laboratory 
51  Hovey  Road 
Pensacola  FL  32508-1046 


Tel:  850-452-2557 
Fax:  850-452-8087 
Email:  jsaxton@namrl.navy.mil 

Jack  Saxton  is  a  Research 
Physiologist  at  the  Nanai  Aerospace 
Medical  Research  Laboratory, 
Pensacola,  FL.  Joe  W.  McDaniel, 
Ph  D.,  CPE,  is  an  Industrial  Engi¬ 
neer  at  the  Air  Force  Research 
Laboratory  Crew  System  Interface 
D  i  V  is  ion,  Wright -Pa  tte  rso  n  A  FB, 
OFI,  arid  the  C SERI  AC  Government 
Manager.  John  Quinn  is  a  Research 
Engineer  with  the  University  of 
Dayton  Research  Institute,  Dayton, 
OH.  And  Commander  Thomas 
Pokoj^ski,  MSC,  USN,  Ph.D.,  is  a 
Project  Manager  with  Aviation 
Survival  Training,  Naval  Air 
Warfare  Center  Training  Systems 
Division,  Orlando,  FL. 


World-renowned  human  factors 
engineer  and  scientist  Dr.  Julien  M. 
(Chris)  Christensen  died  at  age  79  on 
July  10,  1998.  During  more  than  50 
years,  “Chris”  was  a  pioneer  and  world- 
class  leader  in  human  factors  engineer¬ 
ing,  including  his  work  as  an  engineer/ 
scientist  at  the  US  Air  Force  Paul  M.  Fitts 
Human  Engineering  Division.  He  was 
the  third  Division  Chief,  from  1956  to 
1974.  Details  at  the  CSERIAC  website. 
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Dr.  Walter  F.  Grether  died  June 
10,  1998  at  age  86.  With  Dr.  Paul  M. 
Fitts  he  founded  the  US  Army  Air 
Force  Psychology  Branch  at  Wright 
Field,  near  Dayton,  in  August  1945. 
This  later  became  the  Paul  M.  Fitts 
Human  Engineering  Division.  In  1949 
he  succeeded  Dr.  Fitts  as  the  second 
Division  Chief  until  1956,  when  he 
became  Director  of  the  Behavioral 
Sciences  Division. 


Howard  Arnoff,  Naval  Air  Sys¬ 
tems  Command  Senior  Aviation 
Psychologist,  died  on  August  26 
after  30  years  of  government  ser¬ 
vice.  Howard  pioneered  the  appli¬ 
cation  of  human  factors  to  aircraft 
design  and  acquisition.  Despite  a 
slowly  worsening  lung  condition, 
he  continued  to  work,  even  volun¬ 
teering  for  extra  projects. 
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PO  Box  1369. 

Alternative  Control  Technologies  —  Human 
Factors  Issues.  Contact  Dr.  Grant  McMillan, 
AFRL/HECA,  Building  33,  2255  H  Street, 
Wright-Patterson  Air  Force  Base,  OH  45433- 
7022. 

Tel:  +1-937-255-8766 

Fax:  +1-937-255-8752 

Email:  gmcmillan@al.wpafb.af.mil 

October  20-22, 1998 

Yellow  Springs,  OH,  USA 

November  2-5, 1998 

Arlington,  VA,  USA 

November  17-20, 1998 

Scottsdale,  A2,  USA 

A  hands-on  short  course  in  anthropometric 
measurement.  Lecture  topics  include 
automated  techniques,  human  variability,  and 
data  and  product  applications.  Also,  3-D 
scanner  demonstration.  Contact  Anthropology 
Research  Project,  PO  Box  307,  Yellow 

Springs,  OH  45387. 

Defense  Technical  Information  Center  (DTIC) 
Annual  Users  Meeting,  “Maintaining  the 
Information  Edge.”  Contact  Ms,  Julia  Foscue, 
DTIC,  8725  John  J.  Kingman  Road,  Suite  0944, 

Ft.  Belvoir,  VA  22060-6218. 

Tel:  +1-703-767-8236 

Fax:  +1-703-767-8228 

Email:  jfoscue@dtic.mil 

WWW:  http://www,dtic.mil 

6th  Color  Imaging  Conference:  Color  Science, 
Systems,  and  Applications.  Contact  Society  for 
Imaging  Science  &  Technology,  7003 

Kilworth  Lane,  Springfield,  VA  22151. 

Fax:  +1-703-642-9094 

Email:  info@imaging.orgResearch  Project,  PO 

Box  307,  Yellow  Springs,  OH  45387. 

Tel:  +1-937-767-7226 

Fax:  +1-937-767-9350 

Email:  belva.hodge@arp-online.com 

WWW:  http://www.arp-online.com 

November  18-20, 1998 

Gifii,  Japan 

November  22-26,  1998 

Sydney,  Australia 

June  15-17, 1999 

Linkoping,  Sweden 

VSMM  98,  “Futurefusion.” 

Contact  International  Society  on  Virtual 

Systems  and  MultiMedia,  Virtual  Systems 
Laboratory,  Gifu  University,  1-1  Yanagido, 

Gifu  501-1193  Japan. 

Tel/Fax:  +81-58-293-3157 

Email:  vsmm-sec@vsmm.vsl.gifu-u.ac.jp 

WWW :  http://www.vsmm/vsl.gifu-u . ac . jp/ 
vsmm98 

7th  International  Conference  on  Noise  as  a 

Public  Health  Problem,  Noise  Effects  ‘98. 

Contact  Secretariat,  GPO  Box  128,  Sydney 

NSW  2001,  Australia. 

Tel:  +61-2-9262-2277 

Fax:  +61-2-9262-3135 

Email:  noise98@tourhosts.com.au, 

WWW:  http://www.acay.com.au/~dstuckey/ 
noise-effects98 

Annual  International  Conference  on  TQM  and 
Human  Factors.  Contact  Jorgen  Eklund, 

Division  of  Industrial  Ergonomics,  Linkoping 
University,  S-58183  Linkoping,  Sweden 

Email:  jorek@ikp.liu.se 

CSERIAC  Program  Office 

Director:  Mr.  Matt  Kolleck 

CSERIAC  Gateway  is  published  and 

AFRL/HEC/CSERIAC  Bldg  196 

distributed  free  of  charge  by  the 

2261  Monahan  Way 

Government  Technical  Manager: 

Crew  System  Ergonomics  Information 

Wright-Patterson  AFB  OH  45433-7022 

Dr.  Joe  McDaniel 

Analysis  Center  (CSERIAC). 

http :/ /cseriac  .flight  .wpafb  .af.mil 

Associate  Government  Technical 

Editor:  Jeffrey  A.  Landis 

Telephone . 

....(937)255-4842 

Manager:  Ms.  Tanya  Ellifritt 

DSN . 

. 1S5A8A2 

Copy  Editor:  R.  Anita  Cochran 

Facsimile . 

....(937)255-4823 

Government  Technical  Director: 

Gov  Tech  Manager . 

. (937)  255-2558 

Dr.  Kenneth  R.  Boff 

Layout  Editor:  Christina  L.Wright 

VOLUME  IX:  NUMBER  2  (1998) 


GATEWAY 


Words  From  the  Chief  Scientist 

Toward  a  General  Theory  and  Taxonomy  of  Behavior 


Michaei  Fineberg 


O  his  theory  of  human  be- 
\  havior  under  stress  is 
f  discussed  here  in  the  hope 
that  you  will  put  it  to  the 
test.  If  the  theory  has  any  relevance  to 
what  you’re  doing,  try  it  as  an  ex¬ 
planatory  framework.  I  hope  you  are 
challenged  by  what  follows. 

The  American  Heritage  Dictionary 
of  the  English  Language,  1992  edition, 
defines  taxonomy  as  “the  science, 
laws,  or  principles  of  classification; 
systematics.”  Within  the  behavioral 
sciences,  the  definition  has  been 
equally  vague.  DeGreene  (1970)  de¬ 
fined  taxonomy  as  a  “verbal  descrip¬ 
tion  using  an  object-verb  format.”  In 
his  view,  they  are  essentially  lists  of 
verbs  in  hierarchical  order  that  reduce 
behavior  from  higher  level  “observ¬ 
able  and  measurable  behaviors”  down 
to  a  fine  level  of  “meaningless  abstrac¬ 
tion  from  the  real  world.”  Other 
authors  (e.g.,  Levine  &Teichner,  1971; 
Meister,  1985)  have  included  another 
idea,  i.e.,  that  it  is  crucial  to  under¬ 
stand  and  make  explicit  the  model  or 
theory  of  behavior  underlying  the 
structure  of  a  taxonomy.  A  taxonomy 
then,  is  not  merely  a  list  of  labels  with 
semantic  definitions;  it  also  must  have 
syntactic  structure. 

Developing  a  general  theory  of  be¬ 
havior  (GTB)  and  taxonomy  for  both 
individuals  and  groups  for  multiple 
analytical  purposes  is  a  common  thread 
that  runs  through  much  of  the  tax¬ 
onomy  research  (Fineberg,  1995).  Such 
a  taxonomy  would  allow  behavioral 
scientists,  computer  scientists,  engi¬ 
neers,  trainers,  and  operational  users 
to  exchange  data  within  a  common 
framework  and  eliminate  the  need  to 
develop  a  new  taxonomy  for  each 
new  situation.  Meister  (1985)  states 


that  such  a  behavioral  theory  and 
taxonomy  are  required  to  analyze 
behavior  to  its  constituent  elements, 
to  compare  or  relate  two  sets  of  tasks 
by  their  common  underlying 
characteristics  and  behaviors,  and  to 
serve  as  the  common  basis  for 
managing  behavioral  data. 

The  Theory 

In  response  to  this  need,  I  have 
synthesized  a  general  theory  of 
behavior  from  others’  efforts  to  under¬ 
stand  the  relationships  among  the  fac¬ 
tors  that  underlie  human  behavior 
under  stress.  It  is  my  hope  that  the  GTB 
shown  in  Figure  1  will  provide  a  con¬ 
text  for  understanding  the  interaction 
of  those  behaviors  introduced  in  the 
taxonomy  discussed  later.  In  defer¬ 
ence  to  Meister,  GTB  links  the  behav¬ 
iors  to  their  antecedents  “through  indi¬ 
vidual  and  team  preparation  for  com¬ 
bat”  and  to  their  consequences  in  terms 
of  combat  performance  measures. 


The  GTB  is  based  on  the  work  of 
several  authors  in  the  fields  of  human 
performance  measurement  and  stress 
research  beginning  with  Cannon 
(1932)  and  Selye  (1952,  1955,  1956) 
through  the  more  recent  efforts  of 
Alluisi  (1982),  Lazarus  and  Folkman 
(1984),  Gal  (1985),  Fineberg  et  al. 
(1996),  Conroy  et  al.  (1992),  and 
Deitchman  and  Fineberg  (1994, 1995). 
The  GTB  bridges  the  gap  between 
battlefield  stresses  such  as  suppres¬ 
sive  fire;  the  sensory,  psychomotor, 
cognitive,  social,  and  emotional  re¬ 
sponses  to  such  trauma  (stress 
symptoms);  and  the  performance  dec¬ 
rements  as  in  individual  or  team  tasks. 

The  GTB  suggests  that  the  anteced¬ 
ent  conditions  of  generic  battle  stress 
(Dl)  and  the  specific  combat  tasks 
associated  with  particular  scenarios 
(D2)  interact  to  create  a  demand  on 
the  individual  soldier  or  team.  Battle 
stress  is  influenced  by  variables  such 
as  combat  intensity,  weather,  terrain, 
threat  characteristics,  force  ratio, 
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Figure  1.  A  general  theory  of  combatant  behavior  under  stress. 
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environmental  toxins,  wounds,  and 
disease.  The  combat  tasks  to  be  ac¬ 
complished  influence  demand  through 
attributes  such  as  number  and  dura¬ 
tion  of  outputs  required,  difficulty  of 
goal  attainment,  precision,  response 
rate,  and  procedural  complexity 
(Fleishman  &  Quaintance,  1984). 

This  resulting  demand  is  met  by 
another  antecedent  condition,  the  level 
of  readiness  to  perform.  Readiness  is  a 
complex  function  of  an  individual’s 
knowledge,  skills,  abilities  (KSA)  and 
experience  (Rl)  and  interpersonal 
factors  resident  in  his  team  and  unit 
(R2).  Abilities  and  traits  include  com¬ 
prehension,  expression,  fluency  of 
ideas,  originality,  memory,  problem 
sensitivity,  math  reasoning,  induction 
and  deduction,  and  flexibility 
(Fleishman  &  Quaintance,  1984).  In¬ 
terpersonal  factors  include  leadership, 
cohesion  (horizontal  bonding  among 
personnel),  commitment  (vertical 
bonding  to  some  ideal),  role  in  the 


organization,  and  personal  well-be¬ 
ing  (Blades,  1986). 

Demand  and  readiness  are  com¬ 
pared  (either  consciously  or  uncon¬ 
sciously)  and  the  result  yields  an 
initial  estimate  of  one’s  own  ability  to 
meet  the  perceived  demand.  For 
example,  if  readiness  greatly  exceeds 
demand,  no  negative  effects  on  per¬ 
formance  are  perceived.  As  time 
passes,  readiness  may  degrade,  while 
demand  may  remain  steady  or  grow. 
In  any  case,  when  demand  begins  to 
approach  the  remaining  readiness 
level,  individuals  use  reserve  capacity 
to  meet  the  demand  as  predicted  by 
the  General  Adaptation  Syndrome 
(Selye,  1956).  At  this  stage,  additional 
demands  may  cause  the  system  to 
break  down.  The  size  of  the  readiness 
deficit  and  the  individual’s  predispo¬ 
sition  determine  the  character,  preva¬ 
lence,  and  magnitude  of  the  perfor¬ 
mance  decrement.  This  perception  or 
estimate  of  one’s  ability  to  meet  fur¬ 


ther  demands,  plus  knowledge  of  the 
tactical  situation  on  the  ground  and 
prevailing  rumors  and  confusion,  feed 
into  the  mediation  process  in  which 
appraisal  of  the  situation  and  formula¬ 
tion  of  a  course  of  action  occur. 

During  mediation,  the  soldier  forms 
a  subjective  appraisal  of  his  chances 
of  survival  and  success.  This  is  based 
not  on  the  situation  per  se,  but  on 
what  the  combatant  tells  himself  about 
that  situation.  One  is  tempted  to  con¬ 
clude  that  a  low  probability  of  per¬ 
ceived  success  will  inhibit  behavior, 
but  risk-seeking  behavior  cannot  be 
discounted.  Perceived  probability  of 
survival  and  success,  combined  with 
adherence  to  appropriate  tactics  and 
doctrine,  influence  the  selection  and 
implementation  of  effective  behav¬ 
iors.  If  the  perceived  probability  of 
survival  and  success  is  high,  the  sol¬ 
dier  or  team  will  use  its  training  to 
select  and  employ  the  most  appropri- 
Continued  on  page  8 


PhysioKinetics 

Tracking  Systems  and  Devices 

The  PhysioKinetics  (PK)  platform  offers  high  performance  joint  position  (human  or 
mechanical)  measurement  for  analysis  and  control  for  1  to  90  channels  at  rates  of  up 
to  10,000  Hz!  PK  sensors  are  high  resolution,  low  profile,  durable,  light,  have  high 
resistance  to  external  noise,  and  are  immune  to  nearby  metal  objects.  The  latest  in 
wearable  and  portable  tracking  bio-instrumental,  PK  products  are  built  to  your  needs 
and  specifications. 

Features  and  Options: 

•  Data  collection  via  direct  PC  connect,  digital  stream,  data  logging,  IR/RF 
telemetry,  voltage  output,  desktop/laptop/SGI  operation,  options 

•  On-site  installation,  custom  software  routines,  garment  fitting,  custom  sensor 
mounts,  extreme  environments,  and  ruggedization. 

•  Moderate  systera/device  cost,  discounts  available 

•  Versatile  sensor  mounts;  full  body  garments,  gloves,  skin-mount,  and  strap-on 

•  Integrate  alternative  sensors  including  EMG,  pulse,  force,  temperature,  humidity 
acceleration,  and  more. 


Johnson  Kinetics,  Inc. 

:  wwwjohnsonkinetics.com 

Telepresence  Virtual  Reality  Man-Machine  Interface  Workplace  Analysis  Augmented  Control  Targeting/Aiming 
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ate  behaviors  in  a  course  of  action 
designed  to  resolve  the  situation.  If 
this  probability  is  perceived  as  low, 
selection  of  behaviors  will  be  “de¬ 
toured”  through  a  set  of  stress  symp¬ 
toms  that  tend  to  reduce  the 
appropriateness  and  effectiveness  of 
the  behaviors  and  interactions  selected 
relative  to  the  task  at  hand. 

The  effect  of  the  decrements  in 
behavior  modifies  the  initial  capa¬ 
bility  of  the  individual  or  team  by 
some  percentage,  leaving  a  residual 
capacity  to  perform.  This  residual 
capacity,  as  influenced  by  stress  re¬ 
sponses,  translates  to  performances 
that  are  adaptive  (advance  or  re¬ 
treat)  so  long  as  they  are  not  overly 
influenced  by  the  stresses  that  drive 
them.  Performance  becomes  mal¬ 
adaptive  (panic  and  decisional 
paralysis)  when  the  stress  level 
exceeds  some  internal,  idiosyncratic 
threshold. 

The  Taxonomy 

The  GTB  taxonomy  described  in 
detail  in  Fineberg  (1995)  and 
Fineberg  et  al.  (1996),  is  based  on 
the  behavior  description  and  require¬ 
ments  approach  described  by 
Fleishman  and  Quaintance  (1984) 
and  on  an  information-processing 
paradigm.  The  taxonomy  contains 
four  major  taxons  or  classes  of  be¬ 
haviors:  Sensation,  Mediation,  Re¬ 
action,  and  Interaction.  These  major 
classes  are  analyzed  further  into  11 
lower-level  categories  that  are  popu¬ 
lated  by  over  180  action  verbs.  These 
action  verbs  are  seen  as  building 
blocks  of  human  behavior. 

Taxon  A,  Sensation,  contains  the 
first  two  subclasses,  automatic  and 
volitional  behaviors  that  serve  to 
collect,  filter,  condition,  and  retain 
data  from  the  outside  world  for  short 
periods.  These  data  are  passed  on  to 
Taxon  B,  Mediation,  whose  behav¬ 
iors  are  subdivided  into  three  cat¬ 
egories:  preparing  information  for 
assessment,  solving  problems,  and 
making  decisions.  Taxon  B  also 
includes  the  capability  to  revise 


decisions  based  on  knowledge  of 
results.  Taxon  C,  Reaction,  imple¬ 
ments  the  selected  course  of  action 
by  way  of  three  additional  catego¬ 
ries  of  behavior:  physical,  psycho¬ 
motor,  and  conceptual  responses.  It 
keeps  track  of  the  results  of  these 
responses  relative  to  task  accom¬ 
plishment.  The  behaviors  in  Taxon 
D,  Interaction,  communicate,  coor¬ 
dinate,  and  advocate  the  selected 
course  of  action  to  superiors  and 
implement  this  course  of  action  by 
accessing  three  subcategories  of 
behavior  designated:  controlling, 
organizing,  and  leading. 

If  you  have  new  components  to 
add  or  relationships  to  suggest,  let 
me  know  and  Til  attempt  to  inte¬ 
grate  them  into  the  framework.  Any 
theory  is  only  as  good  as  its  ability  to 
generate  creative  thinking.  Please 
share  your  thoughts  with  me  by 
email,  fineberg_michael@bah.com  or 
telephone,  902-703-517.  # 

Michael  Fineberg,  Ph.D.,  is  the  Chief 
Scientist  for  the  CSERIAC  Program 
Office, 
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Air  Force  Research  Laboratory  Human  Effectiveness  Directorate  Colloquium  Series 

The  Power  and  Limits  of  Probiem  Soiving: 

Status  and  Future  Prospects  of  Al  Applications 

Herbert  Simon 


Editor's  note:  In  June  1995  we 
observed  the  50th  Anniversary  of  the 
Armstrong  Laboratory  Fitts  Human 
Engineering  Division  (now  the  Air 
Force  Research  Laboratory  Crew 
System  Interface  Division).  Dr.  Herbert 
Simon,  University  Professor  of 
Computer  Science  and  Psychology, 
Carnegie  Mellon  University,  provided 
the  keynote  address.  A  synopsis  of  his 
address  was  prepared  by  Dr.  Michael 
McNeese,  Air  Force  Research  Labora¬ 
tory  Crew  System  Interface  Division, 
Wright-Patterson  Air  Force  Base,  OH. 
JAL 


©  ituations  beyond  routine 
I  activities  create  problems, 
F  and  hence  problem  solv¬ 
ing,  especially  for  situations 
that  are  changing  and  that  involve  com¬ 
plex  systems.  Problems  are  multidi¬ 
mensional,  can  present  varying  degrees 
of  difficulty,  and  can  lead  to  different 
outcomes  along  different  solution  paths. 
The  progress  of  science  means  solving 
hard  problems,  as  in  the  conduct  of 
everyday  life. 


Process  of  Solving  Problems 

Probiem  solving  begins  with  the  rec¬ 
ognition  that  there  is  a  problem,  and 
proceeds  toward  finding  a  way  to  rep¬ 
resent  it-to  define  a  “problem  space” 
that  describes  the  objects  with  which  it 
is  concerned,  their  properties  and 
mutual  relations,  and  the  means  avail¬ 
able  for  changing  the  situation,  moving 
from  one  point  in  the  problem  space  to 
another,  advancing  toward  the  goal. 
The  problems  we  encounter  profes¬ 
sionally  usually  involve  not  just  a  single 
problem  solver  but  many,  with  all  that 
this  implies  for  the  interweaving  of  their 


technical,  organizational,  and  social 
facets,  all  of  which  have  to  be  dealt  with 
(McNeese,  1992). 

A  large  class  of  problems,  usually 
called  design  problems,  do  not  come 
with  alternative  solutions  already  formed; 
instead,  the  core  of  the  problem  is  to 
generate  these  alternatives.  Design  pro¬ 
blems  go  well  beyond  engineering  and 
architecture.  Creating  a  business  firm’s 
marketing  strategy  is  a  design  problem; 
so  is  forming  a  strategy  for  a  military 
campaign. 

Whatever 
the  form  of  a 
problem  and 
the  sources  of 
its  complexi¬ 
ties,  expert 
problem  solv¬ 
ing  calls  on 
knowledge 
and  search.  If 
the  knowledge 
is  to  be  usable, 
it  has  to  be 
organized  in 
memory  in  a 
particular  way, 
closely  resem¬ 
bling  a  richly 
indexed  ency¬ 
clopedia.  Re¬ 
search  has 
shown,  in 
every  domain 
where  exper¬ 
tise  has  been 
studied,  that 
the  expert  is 
able,  by  train¬ 
ing  and  expe¬ 
rience,  to  rec¬ 
ognize  a  large 
number  (per¬ 


haps  of  the  order  of  100,000)  familiar 
patterns  that  commonly  appear  in  prob¬ 
lem  situations  (for  examples,  the  symp¬ 
toms  the  physician  recognizes  or  iden¬ 
tifies  by  tests,  the  patterns  of  pieces  on 
a  chess  board,  indications  of  enemy 
troop  movements).  Associated  with  these 
patterns  is  knowledge  that  is  relevant  to 
solving  the  problem  signalled  by  the 
pattern.  What  is  usually  called 
“intuition”  or  “insight”  is  precisely  this 
pattern  recognition  and  information 
retrieval  process,  fundamental  to  expert 


The  Observer*:  as  flexible 
as  human  behavior 


The  professional  software  system  for  observing,  coding  and  analyzing  series  of  events:  activities,  postures, 
movements,  positions,  facial  expressions,  social  interactions  or  any  other  aspect  of  human  behavior. 

•  The  Observer  Basic  -  Soft\A/are  for  collection,  analysis,  management  and  presentation  of  observational 
data.  For  live  data  entry  by  a  human  observer,  using  a  desktop  or  handheld  computer. 

•  The  Observer  Mobile  -  Systems  for  mobile  collection  and  analysis  of  observational  data. 

Each  kit  contains  The  Observer  software,  a  handheld  computer  and  accessories. 

>  The  Observer  Video-Pro  -  Professional  system  for  coding,  annotating, 
editing  and  analyzing  behavioral  processes  from  video.  Combines  The  Observer  soft¬ 
ware  with  the  latest  developments  in  video  time  code  and  multimedia  technology. 
Supports  analog  video  tape,  digital  video  tape  and  digital  video  on  disk. 


Human  factors  and  ergonomics  applications; 


Analyzing  human-machine 
interaction 


Usability  testing 
Analyzing  decision  making 


Noldus  Information  Technology  Inc. 
Sterling,  VA  201 65,  U.S.A. 

Phone:  1-703-404-5506 
Toll-free:  1-800-355-9541 
Fax:  1-703-404-5507 
E-mail:  info@noldus.com 


•  Safety  and  risk  assessment 

•  Analyzing  driving  behavior 

•  Virtual  reality  simulations 

•  Analyzing  group  processes 

•  Working  posture  analysis 

•  Time  and  motion  studies 

•  and  much  more! 


Noldus  Information  Technology  b.v. 
Wageningen,  The  Netherlands 

Phone: +31 -{0)3 17497677 
Fax: +31-{0)31 7-424496 
E-mail:  lnfo@noldu$.nl 
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problem  solving  but  not  mysterious. 

Combined  with  this  pattern-recogni¬ 
tion  skill,  the  expert  must  have  general 
problem-solving  skills  (like  reasoning 
from  goals  to  means  for  accomplishing 
them)  and  search  tools  that  are  special¬ 
ized  to  the  task  domain  (for  example, 
knowledge  of  the  mathematics  needed 
to  analyze  aerodynamics  problems,  and 
to  build  computational  models  for  them). 

Computer  Modeling  of  Problem 
Solving 

For  the  past  40  years  or  so,  artificial 
intelligence  programs  for  computers 
have  been  advancing  our  understand¬ 
ing  of  problem  solving-the  processes 
used  by  human  experts  in  solving  prob¬ 
lems  in  their  professional  domains.  The 
theoiy  of  expertise  I  have  just  sketched 
comes  largely  out  of  such  research  and 
the  accompanying  experimentation. 

Computers  have  been  providing  us 
with  a  powerful  tool  to  enhance  our 
problem-solving  powers,  both  by  as¬ 
sisting  human  problem  solvers,  and 
sometimes  by  replacing  them.  Both 
developments,  computer  simulation  of 
human  thinking,  and  the  deployment  of 
artificially  intelligent  expert  systems,  are 
proceeding  today  at  an  accelerating 
pace.  The  remainder  of  my  comments 
will  deal  with  both  these  developments, 
and,  because  I  know  them  best,  I  will 
draw  my  main  examples  from  research 
at  Carnegie  Mellon  University  (CMU). 

I  have  already  sketched  the  shape  of 
the  theory  of  problem  solving  that  has 
emerged  from  the  research.  The  theory 
itself  has  been  formalized  in  the  form  of 
computer  programs,  for  example,  the 
General  Problem  Solver  (GPS;  Newell  8c 
Simon,  1972),  and  Soar  (Newell,  1990). 
These  theories  have  been  tested  by 
obtaining  thinking-aloud  protocols  from 
human  problem  solvers  and  comparing 
them  with  the  computer  traces  on  the 
same  problems.  In  this  way,  we  can 
detennine  the  capacities  of  human  short¬ 
term  and  long-term  memory,  the  rates  at 
which  people  can  process  information, 
preferred  forms  of  representing  infor¬ 
mation  that  make  it  easy  to  process,  and 
information  requirements  for  various 


tasks  and  goals. 

The  research  has  also  encompassed 
learning  processes,  for  experti.se  has  to 
be  acquired.  Considerable  success  has 
been  achieved  in  building  curricula  for 
teaching  high  .school  mathematics,  for 
example,  by  means  of  carefully  de¬ 
signed  sequences  of  worked-out  ex¬ 
amples,  which  largely  replace  lectures 
and  textbooks,  and  which  in  several 
cases  have  been  embodied  in  computer 
tutors  (Anderson  et  al.,  1995). 

An  important  and  exciting  line  of 
research  has  explored  the  role  of  mental 
imagery-the  “mind's  eyc”~in  reasoning 
about  complex  problems  with  the  aid  of 
diagrams,  and  the  interaction  between 
diagrammatic  and  verbal  reasoning. 
Many  important  properties  of  mental 
imagery^  can  be  detected  in  a  rather 
simple  way.  If  the  reader  of  these  lines 
will  form  an  image  of  a  cat,  for  example, 
then  we  can  determine  whether  the 
image  is  a  frontal  or  a  side  view,  what 
features  of  the  cat  arc  present  in  the 
image,  whether  the  view  changes  when 
a  question  is  asked  about  the  length  of 
the  cat’s  tail,  or  whether  the  image 
zooms  when  it  is  asked  whether  the 
cat’s  eye  has  lashes  or  eyebrows. 

This  trivial  example  pro\ldes  a  great 
deal  of  information  about  imageiy^:  that 
words  can  prompt  the  formation  of  a 
mental  image,  and  change  the  image 
and  the  information  displayed  in  it.  At 
the  same  time,  the  image  is  .scanned  to 
reveal  new  information.  The  vi.sual  pro- 
ces.se.s  draw  information  both  from  the 
perceived  world  (e.g.,  Wliat  threat  is 
launching  on  my  radar  screen?)  and 
from  vi.sual  information  already  stored 
in  memory  (What  does  that  kind  of 
cloud  imply  for  the  weather?). 

In  our  research  we  have  experimented 
on  the  u.ses  of  diagrams  to  aid  reason¬ 
ing.  For  example,  economics  teachers 
routinely  use  .supply-demand  diagrams 
to  explain  the  effects  on  prices  of  changes 
in  costs.  What  does  the  student  ha\^e  to 
know  and  to  “see”  in  the  diagram,  to 
follow  the  explanation,  or  to  arrive  at  it 
in  the  first  place?  It  is  easy  to  learn  by- 
rote  that  the  intersection  between  two 
lines  represents  the  equilibrium  of  sup¬ 
ply  and  demand  quantities  and  prices; 


it  is  much  harder  to  u.se  the  diagram  to 
explain  what  would  happen  if  the  price 
lay  above  the  intensection. 

Similarly,  a  simple  diagram  can  be 
u.sed  to  capture  Fin.stein’s  argument  on 
.special  relativity  about  the  times  in¬ 
volved  in  the  reflection  of  a  light  ray 
speeding  along  a  moving  rod.  FIow- 
ever,  it  required  careful  research  to 
show  that  subjects  could  come  to  un¬ 
derstand  what  was  going  on  more 
effectively  if  shown  the  before-and- 
after  .static  situations,  than  if  presented 
with  a  display  on  a  computer  console, 
complete  with  clocks,  of  the  changing 
situation  as  it  unfolded.  (This  paiticular 
experiment  contains  a  warning,  by  the 
way,  for  those  who  might  believe  that 
understanding  always  increa.ses  with 
the  realism  of  the  visual  image~that  a 
dynamic  display  is  always  .superior  to  a 
.static  one,  and  “viitual  reality”  to  le.ss 
reali.stic  images.)  Sometimes  less  is  more. 

In  the  re.search  on  imagery,  cognitive 
simulation  al.so  plays  a  central  role.  A 
computer  model  of  the  mind’s  eye, 
called  CaMeRa  (Tabachneck,  Leonardo, 

Simon,  1997),  provides  a  .set  of 
mechanisms,  a  theoiy,  of  the  processes 
of  human  thinking  that  .solve  the  sup- 
ply-and-demand  problems  I  described, 
and  reach  an  understanding  of  the 
special  relativity  argument  about  the 
light  ray. 

I  hope  that  these  .small  samples  will 
give  a  glimp.se  of  the  ways  in  which 
computer  simulation  of  human  prob¬ 
lem  solving  is  deepening  our  under¬ 
standing  of  human  thought  proce.sses 
in  complex  situations.  I  would  like  to 
conclude  with  an  even  briefer  sample 
of  the  prospects  for  automated  expert 
sy.stems  and  .systems  for  human-com¬ 
puter  collaboration.  Already  many  such 
sy.stems  are  familiar,  albeit  in  rather 
primitive  form. 

There  is,  for  example,  CAD-CAM, 
which  is  today  little  more  than  a  clerical 
aide  to  the  human  draftsman  and  .sched¬ 
uler,  but  which  will  gradually  take  a 
larger  and  larger  part  in  design  and 
scheduling  decisions. 

With  the  accelerated  (and  rather 
chaotic)  growth  of  computer  commu¬ 
nications  and  networking,  we  see  enor- 
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mous  interest  in  search  engines  to 
extract  information  we  want  from  this 
burgeoning  mass  of  data.  To  be  useful, 
it  is  not  enough  for  these  engines  to 
extract;  they  must  select  and  filter,  and 
the  filtering  must  not  be  random  but 
intelligent.  Data  mining  and  data 
routing  will  be  one  of  the  most  active 
and  most  important  areas  of  AI 
investigation  over  the  next  decade. 

Then  there  is  the  matter  of  “groupware” : 
computer  software  to  manage  communi¬ 
cations  and  files  that  support  group 
collaboration  in  organisations.  Again,  we 
see  primitive  beginnings  of  such  group 
aids,  but  also  a  mountain  of  problems 
relating  to  file  “ownership,”  rights  to  modify, 
certification  of  revised  versions, 
confidentiality-aU  the  problems  that  have 
been  faced,  and  more  or  less  solved,  in 
human  organizations,  but  that  require 
drastically  revised  solutions  to  fit  (and  take 
advantage  of)  a  radically  new  technology. 
As  an  example  of  military  interest,  I  men¬ 
tion  designing  and  implementing  the 
electronic  logistic  systems  for  Desert  Storm, 
in  which  some  of  my  CMU  colleagues 
played  an  important  role. 


Conclusions 

Because  complex  systems  use  and 
are  dependent  upon  human  problem 
solving,  and  increasingly  on 
computer  problem  solving,  for  fit¬ 
ness,  survival  and  success,  human 
factors  specialists,  cognitive  engineers, 
and  cognitive  scientists  need  to  un¬ 
derstand  how  electronic  interfaces  and 
intelligent  agents  can  support  and 
enhance  problem  solving.  Through 
continuing  research  in  the  two 
branches  of  artificial  intelligence, 
cognitive  simulation  and  expert 
systems,  we  can  gain  the  knowledge 
that  designers  need  for  building 
effective  intelligent  systems  and 
human  interfaces  with  them.  The  study 
of  cognition,  human  and  machine,  is 
increasingly  revealing  to  us  the  nature 
of  intelligence  and  the  workings  of 
the  mind.  S 
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Air  Force  Research  Laboratory  Human  Effectiveness  Directorate  Colloquium  Series 

A  Conversation  With  Herbert  Simon 


Reuben  L.  Hann 


Editor's  note:  Following  is  an  edited 
transcript  of  a  conversation  with  Dr. 
Herbert  Simon,  University  Professor  of 
Computer  Science  and  Psychology, 
Carnegie  Mellon  University  (see  Fig.  1). 
He  was  a  guest  during  the  50th 
Anniversary  of  the  Armstrong  Labora¬ 
tory  Fitts  Human  Engineering  Division 
(now  the  Air  Force  Research  Laboratory 
Crew  Interface  Ditnsion).  Tbeintefviewet' 
was  Dr.  Reuben  ''Lew"  Hann,  former 
CSERlACCOTR.Dr.Hann,  now  retired, 
kindly  prepared  this  transcription.  JAL 


^SERIAC:  Your  autobiogra¬ 
phy  describes  you  as  a 
political  scientist,  organiza¬ 
tion  theorist,  economist, 
management  scientist,  computer  scien¬ 
tist,  psychologist,  and  philosopher  of 
science.” 

Dr.  Simon:  I  believe  you  will  find 
that  the  next  sentence  after  that  says: 
“ . .  .but  I  have  really  been  doing  only  one 
thing.”  As  an  undergraduate  I  got  in¬ 
volved  in  a  little  research  project  exam¬ 
ining  how  the  city  public  works  depart¬ 
ment  and  the  city  education  department 
made  budget  decisions  about  the  city 
playgrounds.  I  became  intrigued  with 
the  whole  process  of  human  decision 
making.  That’s  really  what  I  have  been 
doing  ever  since.  Economics  was  in¬ 
volved  in  the  decision  making;  we  had 
to  understand  the  psychology  of  it;  then 
computers  came  along,  which  were  the 
obvious  tool  for  constructing  a  psycho¬ 
logical  theory  of  the  mind.  So,  for  me, 
these  areas  really  were  all  related. 

CSERIAC:  You  wrote  that  “...the  logic 
of  discovery  is  quite  different  from  the 
logic  of  verification.”  Could  you  explain 
what  that  meant? 

Dr.  Simon:  Certainly.  Philosophers 
of  science  for  a  long  time  have  been 
concerned  with  how  you  verify  that 
something  is  true — statistical  testing 


Figure  1.  Dr.  Herbert  Simon,  Carnegie  Mellon  University. 


theory  and  such. 

Popper  wrote  a 
book — interest¬ 
ingly  enough 
called  “The  Logic 
of  Discovery” — 
but  the  book  de¬ 
nied  there  was  a 
logic  of  discov¬ 
ery  and  really 
talked  about  veri¬ 
fication.  If, 
by  “logic,”  you 
mean  ways  of  do¬ 
ing  things  more 
reasonably  than 
not,  then  there 
are  reasonable 
ways  of  going  about  discovery — not  of 
guaranteeing  discovery,  but  reason¬ 
able  ways  of  going  about  it.  That’s  what 
I  call  the  logic  of  discovery.  In  our 
research  on  scientific  discovery  we  have 
tried  to  exhibit  some  of  that  logic  by 
building  systems  that  can  make  discov¬ 
eries.  One  way  we  exercise  these  sys¬ 
tems  is  to  provide  the  same  initial 
knowledge  that  existed  at  the  time  of  an 
important  historical  human  discovery, 
and  then  see  where  it  ends  up.  So,  we 
gave  a  computer  program  called  BA¬ 
CON  the  data  that  Keppler  had  about 
the  distances  of  the  planets  from  the  sun 
and  the  periods  of  revolution,  and  asked, 
“What  do  you  make  of  this?”  After  a  few 
seconds  it  came  up  with  Keppler’s  Third 
Law.  That’s  the  game  we  have  been 
playing:  How  can  you  account  for 
genuine  major  scientific  discoveries? 

There  is  another  route  one  of  my 
students,  Raul  Valdes-Perez,  is 
pursuing.  Namely,  can  you  build  a 
system  to  make  discoveries?  He  has 
a  program  called  MECHEM  which  is 
given  information  about  some  of  the 
inputs  to  a  chemical  reaction,  some  of 
the  outputs  (they  need  not  be  com¬ 


plete),  as  well  as  some  of  the  interme¬ 
diate  products.  MECHEMv^iW  then  infer 
a  reaction  chain.  That  system  is  good 
enough  that  he  has  published  four  or 
five  pieces  in  chemical  journals — not  in 
AI  journals — which  is  significant.  He 
thinks  he  has  found  several  plausible 
new  reaction  paths  for  important  known 
reactions;  these  reactions  have  not  been 
fully  understood  thus  far.  That  is  the 
test:  Can  you  come  up  with  new 
discoveries,  which  are  significant  enough 
to  be  published  in  professional  journals 
from  that  discipline? 

C’SFRTAC:  You  received  the  Nobel 
Prize  for  Economic  Science  in  1978. 
One  of  the  most  controversial  concepts 
from  your  work  is  “bounded  rational¬ 
ity.”  Could  you  explain  what  this  means? 

Dr.  Simon:  If  you  look  at  standard 
economic  theory,  they  start  with  the 
heroic  assumption  that  a  businessman 
or  consumer — or  anyone  making  a  buy- 
or-sell  decision — is  sitting  there  with  all 
the  alternatives  in  front  of  them.  Then 
they  have  something  called  a  “utility 
function” — ^a  way  of  evaluating  things; 
they  find  the  maximum  value  and  that 
is  the  decision.  Life  should  be  so  simple. 
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What  we  found  is  that  people  make 
their  search  only  until  they  find  some¬ 
thing  that’s  useful  or  expedient,  and 
looks  good  in  terms  of  their  personal 
experience.  Then  they  stop  the  search 
and  go  with  their  decision. 

CSERIAC:  In  1949  you  went  to  work 
at  Carnegie-Mellon  in  the  business 
school.  There  you  became  involved 
with  the  Rand  Corporation  and  with 
Allen  Newell,  and  in  1955  you  went 
“ . .  .from  being  a  political  scientist/econo¬ 
mist  to  a  cognitive  scientist/psycholo- 
gist.”  What  caused  the  switch? 

Dr,  Simon:  The  group  was  working 
on  the  simulation  of  an  early-warning 
system,  with  simulated  inputs  from  flight 
patterns.  The  only  way  they  could 
figure  to  do  that  was  to  compute  where 
the  flights  were  at  each  second  or  so, 
then  print  a  map  of  the  radar  spots  on 
paper.  They  used  that  as  the  simulated 
radar  scope.  Remember,  until  this  time 
the  computer  was  considered  nothing 
more  than  a  high-speed  calculator — 
that  it  could  only  deal  with  numbers. 
Well,  I  looked  at  their  simulated  radar 
scope  printouts  and  realized  that  we 
were  dealing  here  with  patterns,  not 
numbers.  A  computer  could  obviously 
do  anything  you  can  do  with  patterns. 
That  was  my  insight.  Incidentally  people 
were  using  computers  already  at  that 
time  to  play  chess,  but  they  still  thought 
of  it  as  translating  chess  to  numbers,  not 
patterns. 

CSERJAC:  You  taught  yourself  to 
program  an  IBM  701  and  developed 
what  could  be  called  the  predecessor  to 
LISP.  How  did  this  happen? 

Dr.  Simon:  We  knew,  for  these  kinds 
of  problems,  there  was  no  way  of 
assigning  memory  arrays  to  various 
events.  Furthermore,  there  wasn’t 
enough  memory  to  leave  anything 
permanently  assigned.  So  we  needed  to 
have  a  flexible  way  in  which  anything 
could  become  anything,  so  to  speak. 
List  processing  was  the  way  to  do  this. 
It  really  took  the  systems  programming 
community — even  after  LISP  was  around 
and  running  well — ^almost  10  years  until 
they  began  to  bring  list  processing  into 
the  construction  of  operating  systems. 

CSERIAC:  You  and  your  colleagues 


were  the  fathers  of  Artificial 
Intelligence. 

Dr.  Simon:  We  have  been  accused 
of  that.  At  the  time  we  called  it  “complex 
information  processing.” 

CSERIAC:  We  have  not  heard  much 
lately  about  AJ — at  least  not  in  the  press. 
Do  you  think  it  was  over-hyped? 

Dr.  Simon:  Actually,  I  don’t  think  it 
has  been  greater  than  the  hype  in  any 
other  new  field.  What  made  AI  different 
was  that  the  very  idea  of  it  arouses  a  real 
fear  and  hostility  in  some  human  breasts. 
So  you  are  getting  very  strong 
emotional  reactions.  But  that’s  okay. 
We’ll  live  with  that. 

CSERIAC:  You  talked  today  about 
display  fidelity,  saying  that  virtual  reality 
has  to  be  approached  carefully.  Why  is 
that? 

Dr.  Simon:  Well,  just  making  the 
picture  more  “real”  doesn’t  necessarily 
make  you  understand  or  learn  more.  So, 
it  seems  to  me,  in  developing  virtual 
reality  ideas  as  a  part  of  how  we  are 
going  to  operate  computers,  we  need  to 
find  out  what  it  is  about  virtual  reality 
that  either  educates  or  confuses.  Maybe 
the  word  “reality”  is  wrong.  I  think  the 
word  carries  for  many  people  the  impli¬ 
cation  that  if  you  can  create  a  reality  that 
is  so  real  people  feel  they  are  in  it,  that 
this  is  automatically  beneficial — ^thatyou 
automatically  learn  from  it.  That  may 
not  be  necessarily  tme. 

In  our  old  System  Research  Lab 
study  the  simulation  was  so  “real”  that 
the  airmen  who  were  participating  in 
the  study  actually  wept  when  the 
“Russians”  got  through  the  defenses 
and  “bombed  Seattle.”  How  could 
they  sit  in  that  room  for  six  hours  or 
more  a  day  and  not  begin  to  feel  that 
they  were  really  running  an  early 
warning  station?  Well,  did  that  make  it 
more  educational  or  less  educational? 
It’s  not  clear.  That’s  really  my  warn¬ 
ing:  more  complex  isn’t  necessarily 
better;  you  had  better  understand  what 
the  process  is. 

CSERIAC:  You  have  said  you  would 
“...like  to  understand  the  cognitive 
roots  and  mechanisms  of  mathemati¬ 
cal  competence  and  incompetence. 
There  is  no  question  I  would  more 


like  to  answer  before  my  research 
career  ends.”  Why  do  you  feel  so 
strongly  about  this? 

Dr.  Simon:  Because  I  think  it  has 
very  large  social  consequences.  We  live 
in  a  very  high-tech  world  and  large 
numbers  of  people  feel  shut  out  from 
that  world.  It  makes  them  hostile  to  it. 
They  very  closely  connect  their  inability 
to  penetrate  that  world  to  its  mathemati¬ 
cal  character.  And,  as  long  as  they  carry 
around  that  mathematical  fear  and 
ignorance,  I  don’t  see  how  you  can  get 
them  into  a  state  of  mind  where  they 
feel  they  are  a  part  of  that  world.  I  think 
that’s  extremely  dangerous  in  the  kind 
of  world  we  live  in.  I  find  it  interesting 
that  in  our  society  it  is  socially  accept¬ 
able  to  say  “I  always  was  stupid  in 
math,”  No  one  is  embarrassed  to  say 
that.  But  it  is  not  acceptable  to  say  “I 
never  could  speak  English  well.” 

CSERIAC:  I  will  close  with  a  question 
about  the  future.  What  do  you  think  the 
“hot  spots”  will  be  in  cognitive; 
psychology/cognitive  science  as  we 
enter  the  next  century? 

Dr.  Simon:  Well,  I  suppose  my 
crystal  ball  is  about  as  good  as  anyone 
else’s,  but  one  of  the  areas  I  find 
exciting  now  is  visual  imagery.  For 
instance,  finding  out  how  we  do  rea¬ 
soning  that’s  clearly  not  verbal  or 
logical  in  the  syllogistic  or  proposi¬ 
tional  sense.  What  are  those  kinds  of 
reasoning?  What  does  it  take  to  make 
them  function?  And  then  the  related 
question:  What  are  all  these  different 
ways  of  representing  knowledge  in 
the  brain?  There  may  be  ways  we 
don’t  even  know  of  yet.  After  all,  the 
calculus  has  not  been  around  forever; 
it  got  invented  at  some  point.  It  is  a 
powerful  way  of  representing  large 
numbers  of  systems  of  a  certain  kind. 
So,  where  do  representations  come 
from  and  how  does  any  individual 
acquire  a  representation  and  the 
ability  to  reason  in  it  and  feel  that 
reasoning  in  it  constitutes  understand¬ 
ing  of  the  phenomenon?  Those  seem 
to  me  very  critical  areas.  Of  course, 
associated  with  each  one  are  learning 
questions:  How  do  we  learn  to  do 
these  things?  ® 
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Naval  Air  Warfare  Center  Aircraft  Division 
Crewstation  Technoiogy  Laboratory 


Figure  1,  Resources  of  the  CTL  i)iclucie  a  variety  of  cockpits  and  cui  extoisive  collect  io)}  of 
helmet-mounted  displays. 


Lisa  B.  Achiiie 


\  he  Crewstation  Technol- 
•j  ogy  Laboratory  (CTL)  is 
fj  located  in  the  Human  En- 
gineering  Applications 
Branch  in  the  Crew  Systems  Depart¬ 
ment  at  the  Naval  Air  Warfare  Center 
Aircraft  Division,  Patuxent  River, 
Maryland.  The  department  staff  and 
CTL  provide  human  engineering 
support  to  the  Navy  for  acquisition 
of  aviation  materiel  in  all  phases  of 
the  life  cycle.  The  primary  role  of 
CTL  is  to  enable  integration  of  ad¬ 
vanced  technologies  into  crewstation 
designs  for  Naval  and  Marine  Corps 
aircraft  through  the  development  and 
execution  of  behavioral  test  meth¬ 
ods  and  analyses.  Man-machine  in¬ 
tegration  technology  of  all  types  is 
involved  including  lab,  ground,  and 
flight  testing  of  crewstation  equip¬ 
ment  and  systems.  The  unique  facili¬ 
ties  of  CTL  provide  advanced  flight 
and  mission  task  simulation,  com¬ 
puterized  rapid  prototyping,  image 
processing  and  graphic  workstation 
test  support  applications,  video- 
based  test  documentation  and 
behavioral  data  analysis.  All  of  these 
are  tailored  to  the  high  tempo  of 
aviation  research,  development,  test¬ 
ing,  and  evaluation  support. 

Capabilities 

The  Laboratory  has  expertise  and 
test  and  evaluation  capabilities  in 
several  areas  related  to  the  incorpo¬ 
ration  of  advanced  technology  into 
crewstation  design.  Historically,  one 
focus  of  our  work  has  included 
establishing  the  design  requirements 
for  and  testing  of  helmet-mounted 
displays  (HMD)  and  associated  head 
trackers.  CTL  holds  high-  resolution, 
full-color  HMD’s  and  various 
trackers  for  both  flight  testing  and 


simulation  (see  Fig.  1).  Extensive 
methods  development  has  included 
system  evaluations  using  eye¬ 
tracking  measures;  performance, 
workload,  and  task  analysis;  adap¬ 
tive  automation,  video  data  analysis, 
and  display  symbology.  Advanced 
facilities  and  procedures  in  all  these 
areas  are  available  at  CTL. 

The  Laboratory  is  well  equipped 
to  simulate  a  variety  of  display 
devices.  Facilities  include  a  collec¬ 
tion  of  HMD’s,  networked  cockpit 
simulators  including  Distributed 
Interactive  Simulation  (DLS)  capa¬ 
bilities,  large  screen  displays,  and  a 
virtual  workbench  capable  of  pre¬ 
senting  three-dimensional,  stereo¬ 
scopic  displays.  CTL  also  has  exten¬ 
sive  computing  power  and  the  soft¬ 
ware  and  development  capability  to 
rapidly  prototype  specialized  or 
research-oriented  displays,  crew 
stations,  and  detailed  terrain  models 
for  simulation. 


Human  Engineering  Tools  and 
Techniques 

In  addition  to  executing  tests  and 
evaluations,  CTL’s  function  is  to  de¬ 
sign,  develop,  and  refine  its  own  pro¬ 
cedures,  methods,  and  equipment  to 
facilitate  its  mission.  In  response  to  the 
need  for  quantitative  tools  to  gauge 
human  performance  capabilities,  CTL 
has  developed  several  specialized  yet 
flexible  tools  and  techniques.  Four  are 
described  below. 

Critical  Tracking  7dsk 
The  Critical  Tracking  Task  permits 
evaluation  of  many  aspects  of  pilot 
workload.  The  Critical  Tracking  Task 
software  provides  a  variety  of  control 
tracking  tasks  that  can  be  scaled  to 
dynamically  increase  subject  workload 
with  full  performance  measurement 
and  performance  feedback  control. 
Tracking  control  order  can  be  varied 
from  zero-order  (position)  through 
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Figure  2.  Dr.  Richard  Dunn  demonstrates  the  presentation  capabilities  of  VAT. 


third-order  (“jerk”  or  changing 
acceleration)  control.  The  task  has 
numerous  applications  in  system  and 
workload  testing. 

Frequency-Weighted  Task  Complexity 
Index  (FWTCI) 

The  FWTCI  is  CTL’s  rapid  process¬ 
ing  and  scoring  technique  developed 
for  time-varying  data  (e.g.,  manual 
tracking  task  data).  When  applied  to 
manual  tracking  tasks,  the  process 
converts  stick  movement  data  by  fast 
Fourier  transform  techniques  to  a  per¬ 
spective  spectral  array  (PSA)  for  visual 
inspection  of  time  and  frequency 
domain  information  on  a  three-dimen¬ 
sional  plot.  From  this,  a  new  function, 
the  FWTCI,  is  computed  as  a  summary 
measure  of  task  difficulty. 

Prime  capabilities  developed  in 
video-based  test  applications  include: 

Video  Recorder  Multiplexer  De¬ 
multiplexer  System  (VRMDS) 

This  is  a  custom-built  system  used  to 
document  crew  performance  for  task 
evaluation  and  analysis.  This  system 
was  developed  for  in-flight  video 
recording  to  document  crew  perfor¬ 
mance  for  task  analysis  verification.  It 
is  capable  of  recording  up  to  eight 
different  time-sequenced  video  streams 
as  well  as  digital  data-streams  on  one 
standard  VHS  tape.  The  VRMDS  can 
take  input  from  digital  cameras  which 
provide  high-quality  images.  Individual 
video  streams  can  then  be  de¬ 
multiplexed  for  post-test  analysis. 

Video  Information  Extraction 
Workstation  (VIEWS) 

This  is  a  workstation  for  task  analy¬ 
sis  and  activity  sampling  based  on 
video  tape  input  and  hosted  on  a 
graphic  workstation  computer.  The 
VIEWS  enables  human  factors  engi¬ 
neers  to  more  effectively  and  effi¬ 
ciently  analyze  task  data  from  video¬ 
tapes  or  other  data  streams  recorded 
from  aircraft,  simulation,  or  ground 
tests.  Data  sources  may  include  head 
trackers,  physiological  measurement 
equipment,  or  any  synchronous  or 


asynchronous  source  that  can  be  time- 
referenced  to  test  events.  The  system 
digitizes  video  and  test  data,  allowing 
direct  access  and  manipulation  for 
easy  scoring,  annotation,  and  analysis 
in  accordance  with  a  user-defined 
schema. 

Current  Efforts 

A  current  major  focus  at  CTL  is  the 
Visualization  Architecture  Technology 
(VAT)  project  (see  Fig.  2).  This  effort  is 
to  develop  advanced  visualization  soft¬ 
ware,  and  both  standard  and  stereo¬ 
scopic  display  capability.  The  goal  of 
VAT  is  to  develop  and  demonstrate  the 
power  of  visualization  technology  to 
provide  a  clear  depiction  of  tactically 
relevant  information  for  complex  op¬ 
erations.  The  approach  involves  com¬ 
bining  advanced,  three-dimensional, 
stereoscopic  display  systems  with  high- 
resolution,  geo-referenced  imagery  and 
communications  network  connectiv¬ 
ity  in  a  real-time  command  and  control 
environment.  The  development  of  this 
capability  will  permit  the  evaluation  of 
information  handling  and  processing, 
and  decision  support  technologies  for 
future  systems  designed  to  manage 
the  increasingly  complex  array  of  in¬ 
formation  available  to  warfighters  and 
commanders.  The  ultimate  goals  in¬ 


clude  the  enhancement  of  command 
situation  awareness  and  tempo  of 
operations,  as  well  as  improved  mis¬ 
sion  planning  and  control. 

Staff 

The  CTL  is  permanently  staffed  by  a 
multidisciplinary  team  including 
engineering  psychologists,  mathema¬ 
ticians,  optical  and  electrical  engineers, 
computer  scientists,  and  engineering 
technicians.  For  special  projects,  we 
employ  visiting  scientists  and 
collaborate  with  Navy  scientists  and 
researchers  from  other  facilities.  ® 

For  more  information,  please  contact: 

Dr.  Richard  S.  Dunn 
NAWCAD 

Bldg  2187  Suite  2280 
48110  Shaw  Road  Unit  5 
Patuxent  River  MD  20670-1906 

Tel:  301-342-9245 
Fax:  301-342-9708 

Email:  dunn@setd-ctl.nawcad.navy.mil 

Lisa  B.  Achille,  M.A.,  is  a  Senior 
Engineering  Psychologist  with  the 
Crewstation  Technology  Laboratory, 
Naval  Air  Warfare  Center  Aircraft  Di¬ 
vision,  Patuxent  River,  MD. 
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®  EYE  MOVEMENT  MONTTOraNG 
SYSTEMS  1 - 


ISCAN  is  the  world's  leading  producer  of  video  based  eye 
movement  monitoring  systems.  Since  1980,  our  broad  range 
of  products  has  set  the  pace  for  performance  and  usability  in 
wide  ranging  research,  military  and  medical  applications. 
We  can  provide  off-the-shelf  or  customized  solutions  to  suit 
virtually  any  human  factors  application. 


Products  &  Features  Include; 

*  Non-invasive,  high  resolution,  real- 
time  measurement  of  eye  position,  pu- 
pil  size  and  subject's  point  of  gaze. 

*  Complete  Eye  and  Head  Tracking 

Laboratories,  with  optional  Benchtop,  High  Speed  (up  to  240Hz) 
and  High  Resolution  versions  available. 

*  Integrated  Eye/Head  Tracking  in  VR  Displays. 

*  Ultra  Lightweight  Head  Mounted  Eye  and  Scene  Imaging  Systems. 

*  Specialized  Remote  Mounted  Eye  Imaging  Systems  for  Long  or 
Short  Range  Applications. 

*  Advanced  PCI  Bus  Eye  Tracking  Electronics. 

*  Complete  Data  Acquisition  Hardware  and  Analysis  Software  for 
Determination  of  Subject’s  Visual  Performance. 

I  ISCAN,  Inc. 

I  89  Cambridge  Street 

I  Buriington,  MA  01803  USA  v 

I  Td;  781-273-4455  Fax;  781-273-0076 
I  Web;  www.iscaninc.com  Email:  info@iscaninc.com 


16 


